* 


(19) 


Europaisches Patentamt 
European Patent Office 
Office europeen des brevets 



(12) 


(43) Date of publication: 

23.10.1996 Bulletin 1996/43 

(21) Application number: 96302499.7 

(22) Date of filing: 10.04.1996 


uri'iJ; f; 

(n) EP 0 739 138 A2 

EUROPEAN PATENT APPLICATION 

(51) intci* H04N7/26 


(84) Designated Contracting States: 

• Safranek, Robert James 

DEFRGBNL 

New Providence, New Jersey 07974 (US) 

(30) Priority: 19.04.1995 US 424945 

(74) Representative: 

Watts, Christopher Malcolm Kelway, Dr. 

(71) Applicant: AT&T IPM Corp. 

Lucent Technologies (UK) Ltd, 

Coral Gables, Florida 33134 (US) 

5 Mornington Road 


Woodford Green Essex, IG8 0TU (GB) 

(72) Inventors: 


• Kalmanek, Charles Robert, Jr. 


Short Hills, New Jersey 07078 (US) 



(54) Method and apparatus for matching compressed video signals to a communications channel 


(57) A method and apparatus for matching com- 
pressed video signals to a communications channel. 
The compressed bitstream is partially decompressed 
and the bitstream is regenerated with a reduced bit rate 
to match the channel capacity. Specifically, control in- 
formation is decoded and entropy decoding is per- 
formed on the entropy coded, quantized frequency do- 
main data. Then, the quantized frequency domain data 
is re-quantized and re-entropy coded so that the result- 
ing compressed bitstream does not exceed the channel 


FIG. 4 


capacity bit rate. However, this entire rate conversion 
process is performed without converting the frequency 
domain data out of the frequency domain (and back 
again) as is done by prior art techniques. That is, the 
frequency domain data is not inverse transformed (out 
of the frequency domain) in the process of re-quantiza- 
tion. In this manner, a compressed and stored video sig- 
nal can be matched to the constraints of a given com- 
munications channel with substantially less computa- 
tional cost than is required by the techniques of the prior 
art. 
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Description 


Field of the Invention 


The present invention relates generally to the field of video signal coding and more particularly to the problem of 
matching the leve. of compression of coded video signals to the requ.rements of a g^a^^^SS^ ° 

Background of the Invention 

Over the past several years, video signal coding technology has progressed to the point where substantial com 

affordable d.grtal storage media, ,t has become practical to store large quantities of digital video data SresenS 
v,deo programs such as movies, for example) in such a compressed form. These compressed ^TJeTvZTo 
grams may then subsequently be transmitted over a communications channel to a requesting customeM^on and 
decoded (,e., uncompressed) thereat. Among other applications, this technology may be us^J to S ™ 
to recede a selected v,deo program at a customer-requested time. Such apolica, ons, commonly « 
Demand services, are expected to become qurte commonplace in the near future, in fact, the nl^ZZutT^ 
-s expected by some observers to approach levels comparable to that of today's huge video ren Jmarket 

Meanwhile, of course, the available bandwidth of the various communications channels that might be used for 

tobe IT"!? MOreOVer ' * B Characterislics °' 'hanne, ^ «he available bandwTdfh a'e not TJJ 
to be known when the ongmal video program is compressed (i.e., encoded), or they may change between the Tme the 
v.deo program ,s encoded and the time it is desired that the program be transmitted. Thus, even gtenTe su«. 
compress.on factors which maybe achieved without sacrificing video qualrty. « may not 

:ri7or,^ 

wiHo?" 9 n^ 0 ^ h t0 S ° IVin9 Pr0b,9m ° f bandwidth limita,i °"S is to compromise the divergent goals of maximum 
ou a lL q m r mUm ° f Chamel baPdWidth by St ° ring 3 Vide ° Si 9" al havin 9 ,ess * perceptual" 
™2' h P .T am ^ b6 Com P ressed b V a tart* whteh is larger than those which do not impact The 

2^"° S J 9na, t Even ,hou 9 h there ^y be some reduction in the quality of the resultant video, the quaSy 
level may st.l be sufficient so as not to be noticeable (or at least be acceptable) to most viewers. Unfortunately th s 

ST 5 :? TT T h f 6r qU3lity Vid6 ° UnaVai ' able 6Ven sufficient channel band width is available and ^ 
Anl m ' th ? ,ransmissbn of the vide ° P^am at all when the available bandwidth is very limited 

Another poss.ble solution .s to store multiple copies of each video program. Each copy coukf be encoded at a 

theTn 2ff ^ .fV 8, ^ 3 different com P ression < a <** (Typically, the compressionTactor is varied bTvaJng 
?vT T qUant ' Zer " 3 tefger <> uant * ation s tep size results in a correspondingly terger compreS 

SS^hT T eSt ° tranSmit Vide ° Pr ° 9ram iS reCeK,ed ' the VefSi0n that has a bit «*• »™ (buf c3 
to) the available channel capacrty ,s selected and transmitted. This solution provides high quality video when the^ec 

TrlZ^Tf^^ l 3Vailab,e ' 3nd pfOVideS IOW qualrty video when * is Ho ^er. this approach has the 

t^lroar^ JET" ^ ?F °' ° f ^ Vide ° pr ° 9ram ' When are many thousands of 

video programs (eg mov.es) to be stored, this approach can become quite uneconomic if not totally impractical 

n~^*"?- Uton I" St ° re 3 Sin9 ' e hi9h qU8li,y VfirSi ° n ° f thS video P r °9 ram ' *« to the b- , C ra a e as 

needed at the t.me of transm.ssion. When the transmission channel has sufficient capacity (i.e., a capacity grater 

program wh,ch has been stored direct* transmitted to his or her location for decoding thereat. If, on the other hand 
he channel capacrty ,s insufficient (i.e., less than the bit rate of the stored video program), some means oTreducTna 

I™"* 3Vail3b,e Channe ' CapaCfty COU,d be P rovided in real time,n «* a cas^of couree he 
requesting customer may receive a video of less than perceptually perfect quality. However, in this manne° a sinole 
stored copy of the video program could feed communications channels having varying capacities 9 

One approach to performing such a bit rate reduction on an already coded video signal consists of decodina the 
stored video program to reconstruct the original video data, and then to ^n«^lhi.di to .bit™i^!^ 
the channel capacity. However, for many codecs (coder/decoder systems), the encoder complexly can be several 
orders of magn rtude larger than the complexity of the decoder. Such a complexity asymmetry makes eSnomb sense 
in many appl.cat.ons where a decoder must be included at each customer location"../, in each television^en whe'eas 

adopted by the Moton Picture Experts Group - MPEG-I and MPEG-I. - use motion compensated, dhoWSS 
ransform based systems for which the encoders are far more complex than the decoders ConsequenT'ow^e? 

tllTT S,0fed Vid6 ° ^ ,h6n re " enCOdin9 ,he result wi,h a conventional encode suffe^ rom 

a degree of computat.onal comp.exity which can adversely impact a Vldeo-on-Demand service both economic^ Z 
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in terms of performance. 
Summary of the Invention 

In accordance with an illustrative embodiment of the present invention, a method and apparatus for matching 
compressed video signals to a communications channel is provided. The compressed bitstream is partially decom- 
pressed and the bitstream is regenerated with a reduced bit rate to match the channel capacity. Specifically, control 
information is decoded and entropy decoding is performed on the entropy coded., quantized frequency domain data. 
Then, the quantized frequency domain data is re-quantized and re-entropy coded so that the resulting compressed 
bitstream does not exceed the channel capacity bit rate. However, this entire rate conversion process is performed 
without converting the frequency domain data out of the frequency domain (and back again) as is done by prior art 
techniques. That is, the frequency domain data is not inverse transformed (out of the frequency domain) in the process 
of re-quantization. In this manner, a compressed and stored video signal can be matched to the constraints of a given 
communications channel with substantially less computational cost than is required by the techniques of the prior art. 

Brief Description of the Drawings 

Fig. 1 shows an environment in which a compressed video signal may be matched to a communications channel 
in accordance with an illustrative embodiment of the present invention. 

Fig. 2 shows an illustrative video encoder which may be used in the environment of Fig. 1. 

Fig. 3 shows an illustrative video decoder which may be used in the environment of Fig. 1 . 

Fig. 4 shows a rate conversion system for matching a compressed video signal to a communications channel in 
accordance with a first illustrative embodiment of the present invention. 

Fig. 5 shows an illustrative video encoder having motion compensation coding which may be used in the environ- 
ment of Fig. 1 . 

Fig. 6 shows an illustrative video decoder having motion compensation decoding which may be used in the envi- 
ronment of Fig. 1 . 

Fig. 7 shows a rate conversion system for matching a compressed video signal to a communications channel in 
accordance with a second illustrative embodiment of the present invention- 
Fig. 8 shows the effect of inserting video program segments such as commercials into a video program in accord- 
ance with an illustrative embodiment of the present invention. 

Fig. 9 shows a system for inserting video program segments into a video program in accordance with an illustrative 
embodiment of the present invention. 

Detailed Description 

As is well known in the art, a video signal can be compressed in one of two modes - constant bit rate and variable 
bit rate. For constant bit rate compression, the output rate of the encoder over a fixed interval is a constant. This is 
accomplished by varying the quantizer step size used in the encoder, and providing both the encoder and decoder 
with channel buffers. These buffers are used to ensure that there is always data available for the channel and data 
available from the channel respectively. In addition., the degree of fullness of the encoder's channel buffer can be used 
as a control input for the encoder. If the buffer is filling up too quickly, the quantization step size may be increased, 
which results in a lower output rate from the quantizer. If the buffer is emptying too quickly, the quantization step size 
may be decreased, thereby generating more bits. 

There are two channel constraints induced by this type of communications channel. First, the decoder buffer can 
never be permitted to underflow. This condition occurs when the decoder needs more data and there is nothing left in 
its input buffer. When this occurs, the decoder must wait until more data is arrives, which results in a freezing of the 
resultant output video image. The second constraint is that the decoder buffer must not be permitted to overflow. This 
occurs when data arrives from the channel, and the decoder buffer is full. Since there is no room left in the buffer, the 
data is lost. This occurrence typically results in errors appearing in the resultant output video image. 

In variable bit rate systems, it is assumed that the transmission rate of the channel must be controlled by the 
encoder in order to prevent information from being discarded or excessively delayed in the network. In the context of 
Asynchronous Transfer Mode (ATM) networks, for example, one particular type of channel is known as a leaky bucket 
channel. (As is known to those skilled in the art, ATM is a particular protocol in the category of packet switched network 
protocols. Communication across an ATM network may occur in either a fixed bit rate or a variable bit rate mode.) In 
particular, a leaky bucket channel has a peak rate capacity, a sustainable rate capacity, and a burst time. The burst 
time specifies how long an encoder may transmit at the peak rate without causing loss or excessive delay, whereas 
the encoder may transmit at the sustainable rate indefinitely. 
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constrain, wou.S a^^^^^^T« , tfanSmission ra,e is " than the leaky bucket 
(e.g. by increasing ZZ^^SoTt^tZ 22J» ^ f ""kT ,0 bit rate 

Censure thata^ero^ 

met. Is known by those skilled in the an «,< i. ,<».,,«,„, , . ~ I occur ' and c > lhe onannel constraints are 

on VSriable Bil-Rate Video to ATM Netwo s • EElf ^ ^ * Re ' B,nan " nd & G Hask <* 

2, No. 4. pp. 361-372. Dec^bTMSsS Transacts on C„cu«s end Systems to Video Technology, vol. 

cnan^r:rs 

matting subsystem 16 tunhe? coZSet me vTo sta j™ T " anS "" ' he v * ,e0 cha "™" 
the cons, ra i„,s Oo, avaitable H S^^SS^ES "SSTlr 
signal Horn lhe channel and decodes II ,o produce an output video signal the coded v«)eo 

an «r:^cS2p^ 

coding, a gfcen Irame is cod« £Z .Sl^SI" 7 T * ' B<>Se h me an ' in h ™«™ 
^---^redl^^^^^ 

,h. ess i^r s, b T,Ts,r srr ? p r ^ * sse •*> - me - — * 

bu, provides to a •Zl^^^lST^rT ' eSU * S 3 ^ °' "" omatl0 "' 

c.e£7«r4^^ 

terms, MOUANT and cSuantVv; in ordT, to?™«. ^T* J . . acl ™" a0 »=« lsl » ™V *» product of two 
individual coe«cieras and ZS^T^^Tt " mA f , ° us *» to ' "*!»*« '™,ol ol the quantization ol 

anccdrC=~~ 

compressions JL£ £?£j^£^™J^ ? < " ,an,ized 03,3 »*> ^-mentioned MPEG 

F Q (u,v) = Integer Round (Ffavj / (MQUANT * QUANTYi/.v;) 

where the "Integer Round" function computes the closest integer to the value of its operand 
based ^ 

state of channel i^tSl^^l^^S^- " ^ k ^ ^ 28 monrtors »• 

channel constraints J^^^^^^^ *^ OVerflOW ° f Underflow and that 
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MQUANT to be used for the quantization of the next data block. This approximated optimal value is commonly defined 
as the value that produces the highest quality output image while meeting the channel constraints. Examples of such 
techniques are described, for example, in Reibman and Haskell (see citation above) and in K. Ramchandran, A. Ortega 
and M. Vetterli, "Bit Allocation for Dependent Quantization with Applications to Multiresolution and MPEG Video Coders, 

5 8 IEEE Transactions on Image Processing, vol. 3, no. 5, September 1994. 

In addition, rate control 28 may determine MQUANT based on information provided directly by the communications 
channel itself. (See, e.g., H. Kanakia, P. Mishra and A. Reibman, "An Adaptive Congestion Control Scheme for Real- 
Time Packet Video Transport." Proc. of ACM SIGCOMM, September 1993.) In the illustrative encoder shown in Fig. 
2, for example, both the degree of fullness of channel input buffer 26 and a signal provided directly from the commu- 

io nications channel are available. In other illustrative embodiments, either one or the other of these mechanisms may 
be used alone. 

Entropy coder 24 takes the fixed length quantized transform coefficients and produces a set of variable length 
channel symbols. This process introduces no further information loss, but minimizes the bit rate by coding more com- 
monly occurring values with fewer bits. Specifically, entropy coder 24 produces a compressed data stream whose rate 

is approaches the entropy ol the quantized transform coefficients. Typical entropy coding techniques, familiar to those 
of ordinary skill in the art, include Huffman and Arithmetic coding. 

Finally, the variable length symbols generated by entropy coder 24 are inserted into channel input buffer 26 either 
for transmission across the communications cnannel, or, as in the environment of Fig. 1 1 for storage in storage media 
14 so as to be available for subsequent use. The various types of coded data that are put into channel input buffer 26 

20 include (a) bitstream synchronization information such as "start" and "marker" codes, (b) control information such as 
image size, frame rate, coding modes and quantizer scales (e.g., the value of MQUANT), and (c) the variable length 
coded (Le., entropy coded) quantized transform coefficients themselves. Note that for a constant rate channel, for 
example, the same number of bits are removed from the buffer and transmitted over the channel for each video frame 
(i.e., over the time period represented by each video frame). 

25 Fig. 3 shows a decoder which corresponds to the encoder of Fig. 2 and may illustratively be used to implement 

decoder 18 of Fig. 1. In operation, data which is received from the communications channel is placed into channel 
output buffer 30. For a constant rate channel, for example, the same number of bits arrive and are placed into channel 
output buffer 30 for each video frame (i.e., over the time period represented by each video frame). This data is removed 
from channel output buffer 30 as it is required by the decoder, and the synchronization information and the control 

30 information are extracted therefrom by control information decoder 32. Note that the value of MQUANT in particular is 
extracted as part of the control information. 

The variable length coded quantized transform coefficients are applied to entropy decoder 34 which produces a 
quantized symbol stream. These quantized symbols are then converted back into a matrix of transform coefficients by 
inverse quantizer 36. This matrix, referred to herein as F Q (u,v), is computed by performing a multiplication by MQUANT 

35 and QUANT (u,v) as follows: 

f q( u > v ) = f q( u > v ) * QUANT(u,v) * MQUANT 

40 Finally, the transform coefficients are converted back into the spatial domain by inverse transform 38, which per- 

forms the inverse operation to that of transform 20 of the encoder of Fig. 2. The resultant output images (for the individual 
frames) may then be displayed at the times specified by the synchronization information which was extracted by control 
information decoder 32. The resultant overall video is preferably as perceptually indistinguishable as possible from the 
original video signal. 

45 As described above, channel matching subsystem 16 of the environment of Fig. 1 may be implemented by (a) 

processing the input bitstream with the decoder of Fig. 3 to generate a decoded video signal, and (b) providing the 
resultant decoded video signal to the encoder of Fig. 2 which re-encodes the data for the new channel conditions. 
Alternatively, channel matching subsystem 16 may be implemented by the rate conversion system of Rig. 4 in accord- 
ance with afirst illustrative embodiment of the present invention. In particular, the system of Fig. 4 enables a compressed 

so video signal to be matched to a communications channel with a system of reduced complexity to that of prior art 
techniques. 

The rate conversion system of Fig. A operates as follows. First, the input bitstream is read into channel output 
buffer 30. The control and synchronization information is then extracted by control information decoder 32. Next, the 
variable length coded transform coefficients are decoded by entropy decoder 34. Then, the re-quantization process is 
55 advantageously carried out as a single process by rate change module 40. Moreover, note that this process is performed 
without converting the transform coefficients back into the spatial domain (i.e., to pixel data), as is done, for example, 
by inverse transform 38 of the decoder of Fig. 3 (or, for that matter, transforming the resultant spatial domain data back 
again into the frequency domain, as is done, for example, by transform 20 of the encoder of Fig. 2). 
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Specific^, the matrix of transform coefficients, F q( u,,). b computed by rate change module 40 as foHows: 
F Q (u,v) = FQ(u,v) • (OLD_MQUANT/NEW_MQUANT) 

signa. received from the communion! Tchan^l ^ ° f ,U " n6SS °' Chann6 ' inpUt buffer 26 a 
-anTp^^ 

26 (along with the synchronization WorrSS 25 tS^J^w f ' nSerted intocha <™' input buffer 
channellnth.,^ 

meet the constraints of the ^ antiza,ion leve ' *> as to 

reduced complexity over that of pr^ZS!^ ,h ' S ^ bee " aChieVed W ' h a ^ ha ™9 

signal has been coded with Xhe uslol mSTcZZTJ A beextended to case "here the compressed video 
pensation is a ^iqJ^^^vSJSSS f Jf T^"" ,0 ^ ^ h * e ^ m ° tion Com " 
signal. Inter, rame coding technSulH^^^ll^ ** ^"'^ '° ,ranSmit 3 COded 

blocks of the previously encoded frame Then onT h 6 d« 7 " Pred ' C, '° n ^ bl0CkS ° f the CUrrent ,rame from 
prediction needs to be coded and Emitted ^£ T ,rame bei " 9 ^ and ,he 9 enerated 

--,-d^^ 

from the previously encoded IrBnJ^SS^S^^ ? SpSCI,,Cal ^ the locatio " * chosen block 
locatbn of the prediction block J£££Z To!urZ ITJ^T^ * ^ Sp6Cifi6S the relative 
comprises only a motion vector B^SS^^l t £ h tT, T ** °' ,hS CUrf6nt b,ock 

previously encoded frame) information * **** ^ COded and the prediction b,ock "em the 

subtracter 52 to generate the dSwJ ThilTe^l , ^ " SUbtraCted ,r ° m the prediction b, «* * 
quantized by transform 20 and quantS 22 ^ rel^t , 9 ! transformed the frequency domain and 
the illustrative •n^ci^j^&'Z?^ h*? *' t6ChniqUeS deS ° ribed ab0Ve in the discussio " * 
prediction are entropy coded'by entropy ISer 24 andt Sert ltnT T "1-*" T°" ^ USed t0 9 enerate the 
zation information and the controMn 2!£ for S n T ' nPUt buto 26 (al ° ng With the s y nchroni " 

described above. formation) for transm.ss.on across the communications channel or for storage, as 

f^^T^^^^^^ " ° f Fi9 ' 5 inClUd6S 3 SUbSyS,em Wbich *» 
Q-ntizedand inverse tla^ 

a reconstructed version of the qua^^Zen^Lfr^ r ST *' respectivel * in order <° generate 

from the previous frame and f SS^J?!^™^ "iDt! a * lBd ^ add ° r 54 to *• P««cfion block 

block (as determined by n^Zto^^Z^Zl 5 ? *T US6S the m0tion vec,ors for the given 

supply to subtracter 52)" Sp«^^^rSS ZZ^T & T r° "~ 85 ^ PrediCti0n b,0Ck to 

one of these based on quality of X^eZ^ pr^ * " ^ and Selects 

theS« 

whJp e r^~ 

a matrix of (un-quantized) trar^cJ^^ VeC, ° rS ' qUantiZSd Symb °' S are converted «** Wo 
back into the spatial doma ^n^^ 

the decoder of Fig 3) this soatiaM^in h , ' h ° WSVer ' ,hat " the il,us,ra,ive decoder of Fig. 6 (unlike 

The rnota^?^^ - to actual p^e, dita. 

eratingapredictionb,oc, T he P ;edic,,onbr^^^^ 
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data of the given block of the current frame for use in the output video signal. Not© that the output video signal data is 
also stored back in frame buffer 56 for use in generating the prediction blocks for the next frame. 

In an analogous manner to that described above in connection with the illustrative embodiment of Fig. 4, channel 
matching subsystem 16 of the environment of Fig. 1 may be implemented by (a) processing the input bitstream with 

s the decoder of Fig. 6 to generate a decoded video signal, and (b) providing the resultant decoded video signal to the 
encoder of Fig. 5, which re-encodes the data for the new channel conditions. Alternatively, however, channel matching 
subsystem 16 may be implemented by the illustrative rate conversion system of Fig. 7 in accordance with a second 
illustrative embodiment of the present invention. In particular, the system of Fig. 7 enables a compressed video signal 
having been coded with motion compensated interframe coding to be matched to a communications channel with a 

w system of reduced complexity to that of prior art techniques. 

One difference between performing rate conversion in the case where the compressed video signal employs motion 
compensated interframe coding and in the case employing intraf rame coding only as described above results because 
the quantized difference signal for the current frame depends on the previously encoded frame. The previously encoded 
frame, in turn, depends on the encoded frame previous to it and the quantized difference signal (rom the previous 

is frame. Thus, if the quantized difference signal changes, as it does during the re-quantization process, there is the 
potential for errors to accumulate over time. In order to avoid such problems, the additional error introduced by the re- 
quantization process for a given frame must be computed, saved, and added back in to the quantized difference signal 
for the next frame. 

Thus, the illustrative rate conversion system of Fig. 7 operates as follows. As in the case of the illustrative system 

20 of Fig. 4, the input bitstream is first read into channel output buffer 30. The synchronization information and the control 
information are then extracted by control information decoder 32. Next, the variable length coded transform coefficients 
and motion vectors are decoded by entropy decoder 34 to produce quantized symbols and motion vectors, respectively. 
Then, inverse quantizer 36 converts the quantized symbols back into a matrix of transform coefficients (representing 
differences). Specifically, the inverse quantization comprises multiplication by OLD.MQUANT to produce the recon- 

2$ structed frequency domain difference signal. Before this difference signal is re-quantized to the desired quantization 
level, however, the propagated error which is due to the re-quantization process performed on the previous frame is 
advantageously added to this difference signal by adder 70, in order to avoid the accumulation of the re-quantization 
error as described above. The result of this addition, therefore, is an error-corrected frequency domain difference signal. 
The error-corrected frequency domain difference signal may now be re-quantized by quantizer 22 based on the 

30 value of NEW_MQUANT, which has been determined by rate control 28. Specifically, the re-quantization performed 
by quantizer 22 comprises division by NEW_MQUANT. Finally, the rate converted (Le., re-quantized) information, along 
with the motion vectors which were entropy decoded by entropy decoder 34, are (re-)entropy coded by entropy coder 
24 and inserted into channel input buffer 26 (along with the synchronization and control information) for transmission 
across the communications channel. As in the illustrative system of Fig. 4, the degree of fullness of channel input buffer 

35 26, and/or a signal provided directly from the communications channel, may be used as inputs to rate control module 
28 to determine the appropriate value for NEW_MQUANT. 

To determine the propagated error which is due to the re-quantization process performed on the previous frame, 
the rate converted (i.e., re-quantized) result from quantizer 22 is first inverse quantized by (i.e., multiplied by) 
NEW_MQUANT This operation is performed by inverse quantizer 72. In this manner, a reconstructed (i.e., inverse 

40 quantized) rate converted difference signal is produced. Then, the output of inverse quantizer 36, which comprises a 
reconstructed non-rate converted difference signal, is subtracted from the output of inverse quantizer 72 to determine 
the amount of error which resulted from the re-quantization (i.e., rate conversion) process. 

This determined error, which, advantageously, is still represented in the frequency domain, is now stored in error 
frame buffer 76. In order to generate the propagated error due to rate conversion, however, the frequency domain 

45 information in frame buffer 76 must be motion compensated ~ that is, it must be translated by the applicable motion 
vector values. A conventional approach to achieving such a result would be to apply an inverse transform before frame 
buffer 76, perform conventional motion compensation in the spatial domain, and then apply a (forward) transform after 
the motion compensation. However, it is known to those skilled in the art that various operations on video images, 
including motion compensation, advantageously may be performed directly on data in the transform (i.e., frequency) 

so domain. See, e.g., B. C. Smith and L Rowe, "Algorithms for Manipulating Compressed Images," IEEE Computer 
Graphics and Applications, pp. 34-42, September 1993, and S-F. Chang and D. E. Messerschmidt, "Manipulation and 
Compositing of MC-DCT Compressed video," IEEE Journal on Selected Areas in Communications, vol. 13, No. 1. pp. 
1-11, January 1995. In light of this knowledge, and based on the motion vectors provided by entropy decoder 34, 
frequency domain motion compensation 78 advantageously performs such an operation directly on the data stored in 

55 error frame buffer 76. The result is the propagated error signal due to rate conversion. 

As in the case of the first illustrative embodiment (i.e., the system of Fig. 4), note that the entire rate conversion 
process of the system of Fig. 7 is performed without converting the transform coefficients back into the spatial domain 
(as is done, for example, by inverse transform 38 of the decoder of Fig. 6) or transforming spatial domain data (such 
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Tnthi! ^ erenC f da,a) in, ° ,he d °™" (as is done, ,or example, by transform 20 o. the encoder ot Fia 5> 

In this manner, the compressed video signal is re-encoded with a different quantization H^a^^^L 

tZZT C ° mmUniCa,,0nS Channe '- With USe * a ^ing reduced complexity <T2 S the pt^ 

thatportionbetween^^ 
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segment 84 as the output program after appropriate rate conversion is performed by l^ZZ T^ Z 
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program after appropnate rate conversion is performed by rate conversion module 70 In thinner a ^om pre sled 
JST SS9me "I 38 3 COrTimer0ial ^ be inSSrted int ° an0,her — P-ssed vid^^i^ES 

tTa ive embod^n? 0 * to refer TOtah '* ,0 hardware oJexecutfng soS ) SS 

trative embodiments may comprise digital signal processor (DSP) hardware, such as the AT&T DSP16 , T^lSr 

drift* in cornhLtfo T * f 96 809,6 ' ntegration (VLSI) hardware embodiments, as well as custom VLS\ 
crcurtry .n combination with a general purpose DSP circuit, may also be provided 

Although a number of specific embodiments of this invention have been shown and described herein it tn h* 

Tc r ^l ^l y th ° Se ° f 0fdinary Ski " in art wi,hout de P artin 9 from the scope of the invention 

, 9 ! UStratWe embodiments Scribed above have in each case involved comp«Z v STo 
TlorV^T 9 *0* ' nStant inVentbn may be app,i6d as we " to impressed speech, audio ££££2? 
Z T,t h ' °T S,9nal C ° mpriSin9 data *«* has been compressed with use of a qiSTJSJT 
n addition although the illustrative embodiments shown above have been described in the context of an ATM 


Claims 


of T^LT t 9 3 St 6 TOOded Si9nal *° 9enera,e a second encoded si 9"al which meets a bit rate constraint 
o inintr ? If anne '' ,hS fifSt enCOd6d Si 9 nal and »» second ^nal each representing a common 

domaf ? Signa ' C ° mpriSing qUan,i29d f "*""<* doma * *»-. the quaSfrequenc; 

domain data having been quantized to a first quantization level, the method comprising the steps of: 

re-quantizing the quantized frequency domain data to a second quantization level different than the first auan 
t.zat.on .eve, without transforming the quantized frequency domain data ou, of the Ue^V ^Z 
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second quantization level based on the bit rate constraint of the communications channel; and 
generating the second encoded signal based on the re-quantized frequency domain data. 

2. The method of claim 1 wherein the quantized frequency domain data has been entropy coded, the method further 
comprising the steps of: 

entropy decoding the quantized frequency domain data prior to the re-quantizing step; and 

entropy coding the re-quantized frequency domain data. 

3. The method of claim 1 wherein the quantized frequency domain data has been generated by transforming non- 
frequency domain data into the frequency domain with use of a frequency domain transform. 

4. The method of claim 3 wherein the common original signal represents video information and the non-frequency 
domain data comprises pixel data. 

5. The method of claim 4 wherein the frequency domain transform comprises a discrete cosine transform. 

6. The method of claim 3 wherein the common original signal represents video information and the non-frequency 
domain data comprises motion-compensated interf rame difference data. 

7. The method of claim 6 wherein the frequency domain transform comprises a discrete cosine transform. 

8. The method of claim 3 wherein the common original signal represents audio information and the non-frequency 
domain data comprises signal amplitude data. 

9. The method of claim 1 comprising the further step of determining the bit rate constraint of the communications 
channel based on a measure of fullness of a channel input buffer coupled to the communications channel. 

10. The method of claim 1 comprising the further step of determining the bit rate constraint of the communications 
channel based on a signal received from the communications channel. 

11. The method of claim 1 wherein the communications channel comprises a channel of a packet switched network. 

1 2. The method of claim 1 1 wherein the packet switched network comprises a network having an Asynchronous Trans- 
fer Mode protocol. 

1 3. The method of claim 1 wherein the first encoded signal further comprises encoded control information, the method 
further comprising the step of decoding the encoded control information, and wherein the step of generating the 
second encoded signal comprises generating the second encoded signal further based on the decoded control 
information. 

14. The method of claim 1 comprising the further step of replacing a portion of a third encoded signal which meets the 
bit rate constraint of the communications channel with the second encoded signal. 

15. The method of claim 14 wherein the common original signal and the third encoded signal each represent video 
information and wherein the video information represented by the common original signal comprises a television 
commercial. 

16. A method for communicating an original signal across a communications channel having a bit rate constraint 
associated therewith, the method comprising the steps of: 

encoding the original signal to generate a first encoded signal comprising encoded control information and 
quantized frequency domain data, the quantized frequency domain data quantized to a first quantization level; 

decoding the encoded control information; 
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second quantization level based 0 9 n ^ S ^ 

transmitting the second encoded signal across the communications channel to a destination. 

17 ' ~e Cr,^ in a storage device, and 

quency domain data from the storage devTce ' V d ° ma ' n date C ° mpriSes retrievin 9 the <re- 

18. The method of claim 16 further comprising the steps of: 

receiving the second encoded signal at the destination; and 

feeding the second encoded signal at the destination to produce an output signal representing the original 

19 - oi sto 7 ,he ,irst encoded si9nai h 3 ^ - 

quency domain data f rom ml storag^ dTce ' ° V ^ ** r-rta *« the 

^^^Z^^^^ to generate a second encoded signa, which meets a b* rate 
a common original sig af *e ^ 

domain, the second quant^alTleve based ^ 

q am.zax.on level based on the brt rate constraint of the communications channel; and 

a signal generator of the second encoded signal based on the quantized frequency domain data. 

an entropy decoder adapted to be applied to the quantized frequency domain data; and 
an entropy coder adapted to be applied to the re-quantized frequency domain data 

». The apparatus of 23 M , he lnCflmy Oom8in „ ans)o , m a ^ ^ 

^ 5 ^^^^^^cori^^%sm^ioi^m)pa^^^n^t^^^^l^^^^ v * leo information and the non-frequency 
26. The apparan* o, cfairr, 25 * er9in the )rsqumcy ^ ^ g ^ ^ 
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28. The apparatus of claim 20 further comprising: 

a channel input buffer coupled to the communications channel; and 

a rate control module adapted to determine the bit rate constraint of the communications channel based on a 
measure of fullness of the channel input buffer. 

29. The apparatus of claim 20 further comprising a rate control module adapted to determine the bit rate constraint of 
the communications channel based on a signal received from the communications channel. 

30. The apparatus of claim 20 wherein the communications channel comprises a channel of a packet switched network. 

31. The apparatus of claim 30 wherein the packet switched network comprises a network having an Asynchronous 
Transfer Mode protocol. 

32. The apparatus of claim 20 wherein the first encoded signal further comprises encoded control information, the 
' apparatus further comprising a decoder adapted to be applied to the encoded control information, and wherein 

the signal generator of the second encoded signal is adapted to generate the second encoded signal based on 
both the re-quantized frequency domain data and the decoded control information. 

33. The apparatus of claim 20 further comprising a switch adapted to replace a portion of a third encoded signal with 
" the second encoded signal, wherein the third encoded signal also meets the bit rate constraint of the communi- 
cations channel. 

34. The apparatus of claim 33 wherein the common original signal and the third encoded signal each represent video 
information and wherein the video information represented by the common original signal comprises a television 
commercial. 

35. A communications system for communicating an original signal across a communications channel having a bit 
rate constraint associated therewith, the system comprising: 

an encoder adapted to be applied to the original signal and adapted to generate a first encoded signal com- 
prising encoded control information and quantized frequency domain data, the quantized frequency domain 
data quantized to a first quantization level; 

a decoder adapted to be applied to the encoded control information; 

a quantizer adapted to re-quantize the quantized frequency domain data to a second quantization level different 
than the first quantization level without transforming the quantized frequency domain data out of the frequency 
domain, the second quantization level based on the bit rate constraint associated with the communications 
channel; 

a signal generator of a second encoded signal based on both the encoded control information and the re- 
quantized frequency domain data; and 

a transmitter coupled to the communications channel, the transmitter adapted to transmit the second encoded 
signal across the communications channel to a destination. 

36. The communications system of claim 35 further comprising a storage device adapted to store the first encoded 
signal, and wherein the quantizer is further adapted to retrieve the quantized frequency domain data from the 
storage device. 

37. The communications system of claim 35 further comprising: 

a receiver coupled to the communications channel at the destination, the receiver adapted to receive the 
second encoded signal; and 

a decoder adapted to decode the second encoded signal at the destination and to produce an output signal 
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representing the original signal. 


38. The communications system of claim f,,^ 
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